| 1 |
Methods for Evaluating Text Extraction Toolkits: An Exploratory Investigation
|
|
|
|
In: DTIC (2015)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
How Autism Affects Speech Understanding in Multitalker Environments
|
|
|
|
In: DTIC (2014)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
How Autism Affects Speech Understanding in Multitalker Environments
|
|
|
|
In: DTIC (2013)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Effects of Speech Intensity on the Callsign Acquisition Test (CAT) and Modified Rhyme Test (MRT) Presented in Noise
|
|
|
|
In: DTIC (2012)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Performance Assessments of Two-Way, Free-Form, Speech-to-Speech Translation Systems for Tactical Use
|
|
|
|
In: DTIC (2011)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Strengthening Homeland Security through Improved Foreign Language Capability
|
|
|
|
In: DTIC (2011)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Special Operations Forces Language and Culture Needs Assessment: Defense Language Proficiency Test (DLPT)
|
|
In: DTIC (2010)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Relevance Feedback based on Constrained Clustering: FDU at TREC 09
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Proactive Intelligence (PAINT) Simulated Exploration of Executable Design Strategies (SEEDS)
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Linking Semantic and Knowledge Representations in a Multi-Domain Dialogue System
|
|
|
|
In: DTIC (2007)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Techniques for Automatically Generating Biographical Summaries from News Articles
|
|
|
|
In: DTIC (2007)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
The Effect of Bilingual Term List Size on Dictionary-Based Cross-Language Information Retrieval
|
|
|
|
In: DTIC (2006)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Efficacy in Automated Language Translators
|
|
|
|
In: DTIC (2006)
|
|
Abstract:
This paper suggests an improved measure for evaluating the usefulness of automated machine language translators. With the Global War on Terror (GWOT), the Army has increasing interest and need for accurate language translation more than ever. Today, there are approximately 20,000 linguists with language training in either the Active Duty or Reserve components of the U.S. Army. Coalition operations and U.S. presence in Iraq, Kuwait, and other areas in the Middle East require Arabic translation. Unfortunately, the Army has never been able to maintain the number of linguists it needs, particularly in the hard-to-fill, low-density languages. Previous evaluations of machine translations usually rely on word error rate. Machine translation systems should be rated not in terms of their word error rate but in terms of human comprehension and usefulness, which is some function of word translation, syntax translation, and semantic interpretation. This study introduces a new method of evaluating human comprehension in the context of machine translation using a language translation program known as the Forward Area Language Converter (FALCon). A study was conducted where participants received seven translated articles in a random order. For each of the seven articles, the participants received a set of corresponding comprehension questions. The goal of the questions was to gear the reader toward intelligence gathering and to see if he could grasp main concepts and details. The results of this study suggest that word error rate is not an effective measure of the usefulness of a machine language translator. Comprehension tests perform better at evaluating a human's understanding of a translated document. This study further indicates strengths and weaknesses in each translator. ; See also ADM002075. Presented at the Army Science Conference (25th) held in Orlando, FL on 27-30 November 2006.
|
|
Keyword:
*COMPREHENSION; *MACHINE TRANSLATION; *SYNTAX; COMPARISON; COMPONENT REPORTS; FALCON(FORWARD AREA LANGUAGE CONVERTER); Linguistics; SYMPOSIA; TEST AND EVALUATION; TRANSLATIONS
|
|
URL: http://www.dtic.mil/docs/citations/ADA481410
http://oai.dtic.mil/oai/oai?&verb=getRecord&metadataPrefix=html&identifier=ADA481410
|
|
BASE
|
|
Hide details
|
|
|
| 14 |
An Analysis of Specware and Its Usefulness in the Verification of High Assurance Systems
|
|
|
|
In: DTIC (2006)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Headline Generation for Written and Broadcast News
|
|
|
|
In: DTIC (2005)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Evaluation of Speech Synthesis Systems using the Speech Reception Threshold Methodology
|
|
|
|
In: DTIC (2005)
|
|
BASE
|
|
Show details
|
|
|
| 18 |
Criteria for Appraising Computer-Based Simulations for Teaching Arabic as a Foreign Language
|
|
|
|
In: DTIC AND NTIS (2005)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Minimum Bayes-Risk Decoding for Statistical Machine Translation
|
|
|
|
In: DTIC (2004)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
HITIQA: Towards Analytical Question Answering
|
|
|
|
In: DTIC (2004)
|
|
BASE
|
|
Show details
|
|
|
|
|
